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Description 

[0001] This invention relates generally to vision sys- 
tems for vehicles and, more particularly, to rearview vi- 
sion systems which provide the vehicle operator with 5 
scenic information in the direction rearward of the vehi- 
cle. More particularly, the invention relates to a rearview 
vision system utilizing image capture devices, such as 
CMOS imaging arrays and the like. 
[0002] A long-felt need in the art of vehicle rearview 
vision systems is to reduce the amount of time spent 
gathering information of the condition around the vehicle 
in order to safely carry out a vehicle maneuver, such as 
a turn or a lane change. It has been determined that up 
to about 50 percent of maneuver time is spent gathering 
information with conventional rearview mirrors. This typ- 
ically requires viewing one or more mirrors, turning the 
head and body to check blind spots, and double-check- 
ing the mirrors prior to executing the maneuver. Some 
improvement has been obtained by adjusting mirror op- 
tics, for example, to increase the observed field of view 
rearward of the vehicle. However, this is achieved with 
an increase in image distortion which makes driver 
awareness of conditions to the side and rear of the ve- 
hicle even more difficult. 

[0003] Another long-felt need in the art of vehicle rear- 
view vision systems has been to eliminate exterior rear- 
view mirrors by utilizing image capture devices, such as 
cameras, in combination with dashboard displays. This 
would be beneficial because it would reduce wind drag 
on the vehicle, wind noise and vehicle weight. Further- 
more, rearview mirrors protrude a substantial distance 
from the side of the vehicle, which makes maneuvering 
in tight spaces more difficult. Image capture devices are 
capable of positioning in a greater variety of locations 
on the vehicle, providing more flexibility of vehicle styl- 
ing. It is further expected that camera systems would 
greatly reduce the blind spots to the sides and rear of 
the vehicle common with vehicles equipped with con- 
ventional rearview mirror systems. The driver cannot 
perceive vehicles, objects, or other road users in such 
blind spots without turning his or her body, which inter- 
feres with forward-looking visual activities. 
[0004] Camera-based rearview vision systems for ve- 
hicles have not obtained commercial acceptance. One 
difficulty with proposed systems has been that they 
present a large amount of visual information in a manner 
which is difficult to comprehend. This difficulty arises 
from many factors. In order to significantly reduce blind 
spots, multiple image capture devices are typically po- 
sitioned at various locations on the vehicle. The image 
of an object behind the equipped vehicle is usually cap- 
tured by more than one image capture device at a time 
and displayed in multiple images. This may confuse the 
driver as to whether more than one object is present. 
When multiple image capture devices are positioned at 
different longitudinal locations on the vehicle, objects 
behind the vehicle are at different distances from the im- 



age capture devices. This results in different image siz- 
es for the same object. This effect is especially notice- 
able for laterally extending images, such as a bridge, 
highway crosswalk markings, the earth's horizon, and 
the like. Such images are at different vertical angles with 
respect to the image capture devices. This results in dif- 
ferent vertical positions on the display causing the elon- 
gated image to appear disjointed. 
[0005] JP 58 1 1 0334A discloses a vehicle vision sys- 
tem in which a plurality of video cameras are used to 
pick up views of the surroundings and the separate im- 
ages from these are combined into a composite image. 
However, the composite image provided by JP 58 
110334A is a bird's eye view from above of the entire 
area surrounding the vehicle. 

[0006] JP 01 123587A disclose a system according 
to the pre-characterising part of claim 1 . Again a plurality 
of video cameras are used to pick up views of the sur- 
roundings, and the separate images from these are 
combined into a composite image. However, the com- 
posite image provided by JP 01 123587A is simply a 
collocation of individual images taken from different 
viewpoints and of different shape and sizes. 
[0007] Both of the foregoing systems therefore re- 
quire a considerable degree of driver concentration to 
interpret the image and are not readily usable during 
general driving. 

[0008] It is therefore an object of the invention to pro- 
vide a rearview vision system providing a more driver- 
friendly image. 

[0009] This object is met by the invention claimed in 
claim 1 . 

[0010] Embodiments of the invention will now be de- 
scribed, by way of example, with reference to the ac- 
companying drawings, in which; 

Fig. 1 is a top plan view of a vehicle having a rear- 
view vision system according to the invention; 
Fig. 2 is a side elevation of the vehicle in Fig. 1 ; 
Fig. 3 is a front elevation of a display according to 
the invention; 

Fig. 4 is the same view as Fig. 1 illustrating an al- 
ternative embodiment of the invention; 
Fig. 5 is a block diagram of an electronic system 
according to the invention; 
Fig. 6 is the same view as Fig. 3 illustrating an al- 
ternate mode of operation of the system; 
Fig. 7 is the same view as Fig. 2 illustrating an al- 
ternative embodiment of the invention; 
Fig. 8 is the same view as Fig. 3 illustrating an al- 
ternative embodiment of the invention; 
Fig. 9 is the same view as Figs. 1 and 4 illustrating 
an alternative embodiment of the invention; 
Fig. 10 is the same view as Figs. 3 and 8 illustrating 
an alternative embodiment of the invention; 
Fig. 11 is a chart illustrating the horizontal row of 
pixels (n1, n2) on which an object will be imaged 
from two longitudinally separated image capture 
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devices as that object is spaced at different longitu- 
dinal distances from the image capture devices; 
Fig. 1 2 is a forward elevation of a vehicle passenger 
compartment as viewed by a vehicle driver; 
Fig. 1 3 is a sectional view taken along the lines XIII- 5 

XIII in Fig. 12; 

Fig. 14 is a sectional view taken along the lines XIV- 

XIV in Fig. 12; 

Fig. 15 is the same view as Fig. 14 of an alternative 
embodiment; 

Fig. 16 is the same view as Fig. 14 of another alter- 
native embodiment; 

Fig. 17 is an enlarged view of the display system in 
Fig. 14 illustrating details thereof; 
Fig. 18 is a block diagram similar to Fig. 5 of an al- 
ternative embodiment of the invention; 
Fig. 19 is a side elevation similar to Fig. 2 of an al- 
ternative embodiment of the invention; 
Fig. 20 is an enlarged side elevation of an image 
capture device with portions of the housing re- 
moved in order to reveal internal structure thereof; 
Fig. 21 is a block diagram similar to Fig. 5 of another 
alternative embodiment of the invention; 
Fig. 22 is a block diagram similar to Fig. 5 of another 
alternative embodiment of the invention; 
Fig. 23 is a block diagram similar to Fig. 5 of another 
alternative embodiment of the invention; 
Fig. 24 is a block diagram similar to Fig. 5 of another 
alternative embodiment of the invention; and 
Fig. 25 is a block diagram of a rearview vision sys- 
tem having extended dynamic range capabilities. 

[001 1] Referring now specifically to the drawings, and 
the illustrative embodiments depicted therein, a vehicle 
10, which may be an automobile, a light truck, a sport 
utility vehicle, a van, a bus, a large truck, or the like in- 
cludes a rearview vision system, generally illustrated at 
12, for providing a driver of the vehicle with a view rear- 
wardly of the vehicle with respect to the direction of trav- 
el T of the vehicle (Fig. 1 ). Vision system 12 includes at 
least two side image capture devices 14 positioned, re- 
spectively, on opposite sides of vehicle 10 and a center 
image capture device 1 6 positioned on the lateral cen- 
terline of the vehicle. All of the image capture devices 
are directed generally rearwardly of the vehicle. Rear- 
view vision system 12 additionally includes an image 
processor 18 for receiving data signals from image cap- 
ture devices 14, 16 and synthesizing, from the data sig- 
nals, a composite image 42 which is displayed on a dis- 
play 20. 

[0012] As will be set forth in more detail below, the 
images captured by image capture devices 14, 16 are 
juxtaposed on display 20 by image processor 18 in a 
manner which approximates the view from a single vir- 
tual image capture device positioned forwardly of the ve- 
hicle at a location C and facing rearwardly of the vehicle, 
with the vehicle being transparent to the view of the vir- 
tual image capture device. Vision system 12 provides a 



substantially seamless panoramic view rearwardly of 
the vehicle without duplicate or redundant images of ob- 
jects. Furthermore, elongated, laterally-extending, ob- 
jects, such as the earth's horizon, appear uniform and 
straight across the entire displayed image. The dis- 
played image provides a sense of perspective, which 
enhances the ability of the driver to judge location and 
speed of adjacent trailing vehicles. 
[0013] Each of side image capture devices 14 has a 
field of view 22 and is aimed rearwardly with respect to 
the vehicle about an axis 24 which is at an angle, with 
respect to the vehicle, that is half of the horizontal field 
of view of the image capture device. In this manner, each 
of the image capture devices 14 covers an area bound- 
ed by the side of the vehicle and extending outwardly at 
an angle defined by the horizontal field of view of the 
respective side image capture device. Center image 
capture device 1 6 has a horizontal field of view 26, which 
is symmetrical about the longitudinal axis of the vehicle. 
The field of view of each side image capture device 14 
intersect the field of view of center image capture device 
16 at a point P which is located a distance Q behind 
vehicle 10. 

[0014] Rear blind zones 30 are located symmetrically 
behind vehicle 10 extending from the rear of the vehicle 
to point P. Side blind zones 25 located laterally on re- 
spective sides of the vehicle extend rearwardly of the 
forward field of view 36 of the driver to the field of view 
22 of the respective side image capture device 14. An 
object will not be captured by side image capture devic- 
es 14 or center image capture device 16 if the object is 
entirely within one of the blind zones 25, 30. In order for 
an object, such as another vehicle V or other road user 
travelling to the side of vehicle 10, to be observed by an 
operator of vehicle 10, the object must be either at least 
partially within the forward field of view 36 of the driver 
or be captured by image capture devices 14,16 and dis- 
played on display 20. Fig. 4 illustrates vehicle 10 trav- 
elling on a three-lane highway having lanes L1 , L2, and 
L3 with the vehicle in lane L2. Another vehicle V is 
shown positioned mostly within one of the blind zones 
25, but with the rearmost portion of the vehicle V extend- 
ing into field of view 22 where the vehicle image will be 
captured by one of side image capture devices 14. In 
the illustrated embodiment, vehicle V is a motorcycle 
travelling in the center of lanes L1 or L3 and represents 
a worst case for observing a vehicle travelling at least 
partially within one of the blind zones 25. In order for a 
portion of vehicle V to be extending either forwardly or 
rearwardly of the respective blind zone 25, where the 
vehicle V may be observed by either the forward field of 
view 36 of the driver or by the rearview vision system 
12, the field of view 22 of side image capture devices 
14 must be sufficiently wide to capture a portion of ve- 
hicle V as illustrated in Fig. 4. Preferably, the horizontal 
field of view 22 of side image capture devices 14 is no 
greater than that required to provide sufficient coverage 
which would be in the range of between approximately 



15 



20 



25 



30 



35 



40 



45 



50 



3 



5 



EP 0 830 267 B1 



6 



55 degrees and approximately 70 degrees. In the illus- 
trated embodiment, the horizontal field of view 22 is 61 
degrees. In order for a portion of vehicle V to be within 
a vertical field of view 40 of one of side image capture 
devices 14, the field of view should extend to the pave- 5 
ment at a plane M which intersects vehicle V (Fig. 2). 
Preferably, vertical field of view 40 is between approxi- 
mately 60 degrees and approximately 75 degrees. In the 
illustrated embodiment, vertical field of view 40 is 66 de- 
grees. 

[001 5] A left overlap zone 32 and a right overlap zone 
34 extend rearward from respective points P where the 
horizontal fields of view of the side image capture de- 
vices intersect the field of view of center image capture 
device 16. Overlap zones 32, 34 define areas within 
which an object will be captured both by center image 
capture device 16 and one of the side image capture 
devices 14. An object in an overlap zone 32, 34 will ap- 
pear on display 20 in multiple image portions in a redun- 
dant or duplicative fashion. In order to avoid the pres- 
entation of redundant information to the driver, and 
thereby avoid confusion and simplify the task of extract- 
ing information from the multiple images or combined 
images on display 20, the object should avoid overlap- 
ping zones 32, 34. In practice, this may be accomplished 
to a satisfactory extent by moving points P away from 
the vehicle and thereby increasing distance Q. It is de- 
sirable to increase distance Q to a length that will ex- 
clude vehicles travelling at a typical separation distance 
behind vehicle 10 from overlapping zones 32, 34. This 
separation distance is usually a function of the speed at 
which the vehicles on the highway are travelling. There- 
fore, optionally, distance Q may be made variable, not 
fixed. In such embodiment, the faster the vehicles are 
travelling, the further Q should be moved behind vehicle 
10 to keep overlap zones 32 and 34 outside of the rec- 
ommended vehicle spacing. If, however, the vehicles 
are travelling at a slower speed, then the generally ac- 
cepted recommendation for vehicle spacing decreases 
and it is more likely that a vehicle will be within overlap 
zone 32, 34. Therefore, the distance Q may be selected 
to accommodate expected vehicle spacing for an aver- 
age driving speed of vehicle 10. 
[0016] Distance Q is a function of the effective hori- 
zontal field of view 26 of center image capture device 
16. As field of view 26 decreases, points P move further 
rearward of the vehicle from a distance Q 1( to a distance 
Q 2 , as best illustrated in Fig. 4. In order to increase dis- 
tance Q to eliminate redundant and duplicative informa- 
tion displayed on display 20 for most driving conditions 
of vehicle 10, field of view 26 is preferably less than 12 
degrees. In the illustrated embodiment, field of view 26 
is between 6 and 8 degrees. Alternatively, distance Q 
may be dynamically adjusted according to some param- 
eter, such as the speed of vehicle 10. This would allow 
Q to be greater when the vehicle is travelling at a faster 
speed, where vehicle separation tends to be larger, and 
vice versa. Field of view 26 may be adjusted by utilizing 



a selective presentation of pixels of the captured image 
in the displayed image. 

[0017] Referring to Fig. 3, image display device 20 
displays a composite image 42 made up of a left image 
portion 44, a right image portion 46, and a center image 
portion 48. Each image portion 44-48 is reversed from 
the image as captured by the respective image capture 
device 14, 16 utilizing conventional techniques. These 
techniques include reading the image in reverse with the 
image capture device, writing the image in reverse to 
display device 20, or reversing the image in image proc- 
essor 18. Left image portion 44 is joined with central im- 
age portion 48 at a boundary 50. Central image portion 
48 is joined with right image portion 46 at a boundary 
52. As may best be seen in Fig. 3, the image portions 
at boundaries 50 and 52 are continuous whereby com- 
posite image 42 is a seamless panoramic view rear- 
wardly of the vehicle. As also is apparent from Fig. 3, 
central image portion 48 is narrower than either left im- 
age portion 44 or right image portion 46. This is a result 
of reducing the horizontal field of view 26 of center im- 
age capture device 16 sufficiently to move points P, and 
thus overlap zones 32 and 34, a sufficient distance be- 
hind vehicle 10 to reduce redundant and duplicative im- 
ages between image portions 44-48. Composite image 
42 provides a clear image, which avoids confusion and 
simplifies the task of extracting information from the mul- 
tiple image portions 44-48. As also may be seen by ref- 
erence to Fig. 3, display 20 may additionally include in- 
dicia such as the readout of a compass 54, vehicle 
speed 56, turn signals 58, and the like as well as other 
graphical or video displays, such as a navigation dis- 
play, a map display, and a forward-facing vision system. 
In this manner, rearview vision system 1 2 may be a com- 
pass vision system or an information vision system. 
[0018] In the embodiment of rearview vision system 
12 having a dynamically adjusted value of distance Q, 
the spacing between boundaries 50 and 52 will dynam- 
ically adjust in sequence with the adjustment of distance 
Q. Thus, as overlap zones 32, 34 move further away 
from the vehicle; for example, in response to an increase 
in speed of the vehicle, boundary lines 50 and 52 will 
move closer together and vice versa. In this manner, 
composite image 42 is dynamic, having image portions 
of dynamically adaptive sizes. 

[0019] Display 20 is of a size to be as natural as pos- 
sible to the driver. This is a function of the size of the 
displayed image and the distance between the display 
and the driver. Preferably, the displayed image simu- 
lates an image reflected by a rearview mirror. As such, 
the size of the displayed image is approximately the 
combined areas of the three rearview mirrors (one inte- 
rior mirror and two exterior mirrors) conventionally used 
with vehicles. As best seen by reference to Figs. 2 and 
12, display 20 is preferably positioned within the driver's 
physiological field of view forward of the vehicle, gener- 
ally illustrated at 70, through the windshield 72 without 
significantly obstructing the forward field of view. It is 
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known that the driver's field of view, with the head and 
eyes fixed forward, extends further in a downward di- 
rection than in an upward direction. Display 20 could be 
located above the field of view 70 wherein the display 
may be observed at the upward portion of the driver's 
field of view. However, the position for the display illus- 
trated in Figs. 2 and 12 is preferred wherein the display 
is within the lower portion of the driver's field of view. 
[0020] Display 20 may be a direct view flat panel dis- 
play, such as a back-lit or reflective liquid crystal display, 
a plasma display, a field emission display, a cathode ray 
tube electroluminescent, light-emitting diode or deform- 
able mirror display. The display may be mounted/at- 
tached to the dashboard, facia or header, or to the wind- 
shield at a position conventionally occupied by an inte- 
rior rearview mirror. However, the synthesized image 
could be displayed using other display techniques such 
as to provide a projected or virtual image. Alternatively, 
a virtual image may be displayed on an opaque display 
adjacent the forward field of view. Alternatively, a virtual 
image may be displayed on a view-through heads-up 
display in which the image is superimposed on the for- 
ward field of view. 

[0021] In the embodiment illustrated in Figs. 12-17, 
display 20 displays an image at a focal length that is 
forward of the passenger compartment of vehicle 10. 
Preferably, the image displayed by display 20 is at a fo- 
cal length that is within the driver's normal depth of field 
when viewing a distant object. Display 20 includes an 
image generator 74, which produces an image captured 
by one or more image capture devices 14, 16, and an 
optical correction system 76, which increases the focal 
distance of the image generated by image generator 74. 
In the illustrated embodiment, optic correction system 
76 increases the focal distance by collimating the rays, 
generally indicated at X, from diverging rays to generally 
parallel rays projected from the display. Optical correc- 
tion system 76 additionally magnifies the image. In the 
illustrated embodiment, the magnification is a factor of 
two. In this manner, optical corrective system 76 has the 
advantage of extending the focal distance of the image 
generated by image generator 74 and enlarging the im- 
age by the factor of magnification thereof. This advan- 
tageously allows each image generator 74 to project all 
or a portion of an image captured by one of image cap- 
ture devices 14, 16, or a combination of portions of im- 
ages from one or more image capture devices, by tiling 
the images or image portions. This is accomplished be- 
cause the images projected from optical correction sys- 
tem 76 may abut even though the corresponding image 
generators 74 do not. This provides a convenient tech- 
nique for joining the images synthesized from the image 
capture devices into a unitary image which represents 
a panoramic view rearward of the vehicle. 
[0022] In the embodiment illustrated in Fig. 1 4, display 
20 is an opaque projection display which projects the 
image directly toward the driver. In the embodiment il- 
lustrated in Fig. 15, a display device 120 is a view- 



through heads-up display in which the rays X are pro- 
jected generally upwardly by image generator 74 and 
optical correction system 76 which are generally verti- 
cally aligned, or aligned forward of vertical. The rays X 

5 are reflected off a first surface of windshield 72 in the 
direction of the driver. Windshield 72 acts as a combiner 
which combines the image displayed by display 1 20 with 
a portion of the forward field of view 70 observed by the 
driver. In the embodiment illustrated in Fig. 15, a com- 

10 biner other than the windshield may be used. Examples 
may be holographic or diffractive optical film elements 
or beam splitters of metal or dielectric thin films. Further- 
more, image processor 18 may generate a line in the 
shape of a polygon, such as a rectangle, around rear 

15 image 42. This provides a border around the image to 
differentiate the rear view from the view forward of the 
vehicle. 

[0023] In the embodiment illustrated in Fig. 1 6, display 
20A is oriented at an angle with respect to the forward 

20 field of view of driver D. Image rays X are reflected by 
a mirror 1 40 toward the driver. Display 20A is an opaque 
display, with mirror 140 blocking the driver's view of near 
field objects, such as wipers 98 and the like. Display 20A 
has the advantage of being capable of location within a 

25 forward portion of the dashboard. Additionally, the only 
portion of the display visible to the driver is mirror 140. 
This allows near field portions of the display to be sig- 
nificantly reduced. 

[0024] Because display 20 has a relatively long focus 

30 distance, display 20 defines an observation cone, gen- 
erally designated 78, within which the displayed image 
can be observed. Therefore, the head of the driver must 
be properly oriented with respect to observation cone 
78 in order to allow the driver to observe the displayed 

35 image. However, drivers come in various sizes. There- 
fore, a driver may be too tall or too short to have his or 
her head properly positioned within observation cone 
78. In order to provide for various size drivers along with 
various adjustments in seating positions and the like, an 

40 accommodation means, generally illustrated at 80, may 
be provided in order to accommodate variations in the 
relationship between a driver's head and observation 
cone 78. In the illustrated embodiment, accomodation 
means 80 includes adjustment means 82 for adjusting 

45 the position of observation cone 78. The adjustment 
means may adjust the position of the observation cone 
either vertically, horizontally, or both vertically and hori- 
zontally. A vertical adjustment means 82 is illustrated in 
Fig. 1 3 in which the adjustment means includes an elec- 

50 trie actuator 84 which is joined by linkage 86 with a por- 
tion of a housing 88 of display 20. Actuator 84 is elec- 
trically interconnected through a reversing switch 90 
with a driver-operated actuator 92 which may be posi- 
tioned on dashboard 94 or other convenient position ac- 

55 cessible to the driver. Housing 88 may be adjustably 
mounted, such as by a pivot 96, in order to allow housing 
88 to be adjustably repositioned with respect to dash- 
board 94. In this manner, by operation of actuator 92, 
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housing 88 may be pivoted upwardly or downwardly with 
respect to pivot 96 in order to adjust the direction of ob- 
servation cone 78. In this manner, the location of obser- 
vation cone 78 may be adjusted in order to coincide with 
the location of the driver's head. In a similar fashion, the 
position of observation cone 78 may be adjusted later- 
ally, if desired. If a view-through heads-up display of the 
type illustrated in Fig. 15 is utilized, the position of the 
observation cone may be adjusted vertically and later- 
ally, in a similar manner, by mechanical or optical ad- 
justments of display 20. 

[0025] Accomodation means 80 may include extend- 
ing the rearward field of view displayed by display 20 
laterally outwardly with respect to the bezel 89 beyond 
that normally observed by a driver. In this manner,. a 
driver's head located generally centrally within observa- 
tion cone 78 will observe a view generally rearwardly of 
the vehicle. As the driver's head is moved laterally within 
observation cone 78, the driver will observe images 
more laterally to the side of the vehicle as would occur 
if the driver's head were to be moved with respect to a 
conventional optical rearview mirror system. 
[0026] Vehicle 1 0 may include one or more near field 
view objects adjacent forward field of view 70. One such 
object is a windshield wiper 98 of the vehicle. Other such 
objects may include the top of dashboard 94, the frame 
around windshield 72, the hoodline, and the like. The 
housing of display 20 in Fig. 14 and mirror 140 in Fig. 
15 are positioned with respect to forward field of view 
70 such that housing 88 or mirror 140 covers any near 
field of view objects in the portion of the forward field of 
view adjacent display 20, 20A. In this manner, the gaze 
of the driver can switch between forward field of view 70 
and the image displayed on display 20, without the eyes 
of the driver focusing on any significant near field ob- 
jects. This is based upon a discovery that, even though 
the eyes of the driver are switching between the long 
focal distance of the forward field of view and the long 
focal distance of the image displayed by display 20, the 
eyes of the operator will unconsciously momentarily fo- 
cus on any near field object positioned between the long 
focal distance views. Therefore, by blocking the driver's 
gaze of any near field objects, the eyes of the driver will 
be less stimulated to refocus during the transition from 
field of view 70 to display 20 and back again. 
[0027] Image processor 18, which supplies a video 
signal 100 to image generator 74, may have a second 
input 102 which modulates the intensity level of the im- 
age generated by image generator 74 and displayed by 
display 20 (Fig. 14). The illumination level of the display 
is set in response to an ambient light input 1 04 which is 
an indication of the ambient light level around vehicle 
10. Image processor 18 responds to the value of ambi- 
ent light input 104 by producing a luminance intensity 
signal 102 which increases the intensity of the display 
in response to increases in ambient light level and de- 
creases the intensity of the display in response to de- 
creases in ambient light level. However, the level of dis- 



play luminance may be limited to vary between upper 
and lower limits such that, once ambient light reaches 
a particular upper level, further increases in ambient 
light level will not result in a further increase in display 

5 intensity. Likewise, once the ambient light level decreas- 
es below a particular value, further reductions in ambi- 
ent light level will not result in further reduction in display 
intensity. Ambient light input 104 may be produced by a 
separate ambient light sensor of the type which produc- 

10 es a continuously variable output in response to varia- 
tions in ambient light levels, in which case, the intensity 
of display 20 may be proportionately adjusted. Alterna- 
tively, ambient light input 104 may be produced by a ve- 
hicle headlight control system (not shown) which switch- 
es es the vehicle headlights on, or to a nighttime condition, 
in response to decreases in ambient light levels and 
switches the vehicle headlights off, or to a daytime run- 
ning light condition, in response to increasing ambient 
light levels. Such system is disclosed in EP 0 693 397 A. 

20 [0028] If the ambient light signal supplied to ambient 
light input 1 04 is a binary signal representative of a day- 
time ambient light level and a nighttime ambient light lev- 
el, image processor 1 8 would typically provide a signal 
on luminance intensity line 1 02 that would switch the in- 

25 tensity level of display 20 between two intensity levels. 
Alternatively, ambient light input 104 may be supplied 
with a signal developed by one or more image capture 
devices 14,16. The ambient light signal would be based 
upon an average intensity value sensed by all, or a 

30 group of, pixels in the image capture device or devices. 
This embodiment eliminates the necessity for a sepa- 
rate ambient light sensor. Alternatively, ambient light in- 
put 1 04 may be responsive to manual actuation of the 
vehicle's headlights by the driver. Additionally, a comfort 

35 level setting may be provided to allow the driver to adjust 
to a preferred brightness at one ambient light condition. 
Thereafter, the system automatically adjusts display 
brightness according to ambient light changes. 
[0029] In the illustrated embodiment, display 20 incor- 

40 porates a combined image generator and optical cor- 
rection system 106 which provides for both image mag- 
nification and light ray collimation. In this manner, the 
image projected from display 20 is larger than the image 
generated by image generator 74 and has a focal length 

45 that is greater than the separation distance between the 
image generator and the driver and, preferably, is gen- 
erally at infinity (Fig. 17). Combined image generator 
and an optical correction system 106 is disclosed in de- 
tail in US 5 050 966 A for an OPTICAL COMBINER COL- 

50 LIMATING APPARATUS; US 4 859 031 A for an OPTI- 
CAL COLLIMATING APPARATUS; US 4 900 133 A for 
a HEADS-UP DISPLAY COMBINER UTILIZING A 
CHOLESTERIC LIQUID CRYSTAL ELEMENT; US 4 
987 410 A for a MULTIPLE IMAGE FORMING APPA- 

55 RATUS; and US 5 408 346 A for an OPTICAL COLLI- 
MATING DEVICE EMPLOYING CHOLESTERIC LIQ- 
UID CRYSTAL AND NON-TRANSMISSIVE REFLEC- 
TOR 
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[0030] Suffice it to say, combined image generator 
and optical correction system 106 includes a light 
source 108 which generates broad band white light 
which is gathered and reflected by a parabolic reflector 
110. In the illustrative embodiment, light source 108 is 
a tungsten halogen incandescent lamp. The light rays 
then pass through a dielectric green filter 112 which 
passes light in a specific region of the green portion of 
the spectrum and through a hot mirror 114 which re- 
moves the infrared content of the spectrum. Light then 
passes through a holographic diffuser 116 which ho- 
mogenizes and shapes the light pattern. The light rays 
then pass through a monochrome liquid crystal display 
with opposing linear polarizers 118 which is supplied 
with a video signal by image processor 18. Items 
108-118 make up image generator 74, which, in the il- 
lustrative embodiment, is a transmissive backlit liquid 
crystal display. However, image generator 74 could ad- 
ditionally be an emissive display or a reflective display, 
all of which are well known in the art. 
[0031] Light rays of the image generated by image 
generator 74 next pass through an anti-reflective coated 
cover glass 120 which is joined with a left-hand circular 
polarizer 122 which is bonded to this cover glass. The 
opposite surface of circular polarizer 122 is bonded to 
a lens 124 having a 50/50 dielectric coating. Such die- 
lectric coating allows light rays to be both transmitted 
through the lens and reflected by the lens. The left-hand 
polarized light X' transmitted through lens 124 contacts 
a cholesteric liquid crystal layer (CLC) 126 which is left- 
hand polarized, which is what gives efficient reflection 
of left-hand polarized light X', as illustrated at X". Fifty 
percent (50%) of light rays X" get efficiently reflected by 
the 50/50 beam splitter on lens 124 as right-hand circu- 
lar polarized light X"'. Right-hand polarized light X m is 
transmitted by CLC layer 126 and passes through a 
right-hand circular polarizer 1 28 and an anti-reflective 
coated cover glass 1 30. 

[0032] As can be seen by reference to Fig. 1 7, the op- 
tical configuration of lens 124 in combination with the 
left-hand and right-hand circular polarizers 1 22, 1 28 and 
cholesteric liquid crystal layer (CLC) 126, provide image 
magnification as well as collimate the image light in or- 
der to produce a very long focal distance image. Advan- 
tageously, this structure allows image portions from mul- 
tiple image capture devices to be tiled into a unitary im- 
age. Fig. 1 7 illustrates an approach using a single image 
generator. Merging of multiple image portions would re- 
quire additional combined image generator and optica! 
correction systems. Although image generators 74 for 
each of the image portions are laterally spaced apart 
from each other, the amplification produced by com- 
bined image generator and optical correction system 
106 causes the image portions to merge at their periph- 
ery. Fig. 17 illustrates an approach using a single image 
generator. Merging of multiple image portions would re- 
quire additional combined image generators and optical 
correction systems. Other optical elements such as 



prisms, or other lenses, may be necessary to merge im- 
ages to form a unitary image. Although the invention is 
illustrated with a combined image generator and optical 
correction system using cholesteric liquid crystal optical 

5 processing, other optical correction systems, as are 
known in the art, may be used. What is required is that 
the optical system generally collimates the light gener- 
ated by the image generator and, preferably, provides 
amplification to the generated image. 

10 [0033] In the illustrated embodiment, rear image 42, 
synthesized from the output of image capture devices 
14, 16, has a lateral width verses vertical height aspect 
ratio that is between approximately 4:1 and 2:1. Most 
preferably, the aspect ratio of image 42 is 8:3. This al- 

15 lows a panoramic view rearwardly of the vehicle with an 
optimum information content while reducing display of 
irrelevant information. The aspect ratio of display 20 
may be different from that of the displayed synthesized 
image 42. The remaining portion of the display, either 

20 above or below image 42, may be utilized to display im- 
ages other than synthesized image 42. For example, the 
remaining portion of the display can be used to display 
auxiliary information such as one or more vehicle-oper- 
ating parameters, such as vehicle speed indicia 56, 

25 heading indicia 54, or turn signal indicia 58. Alternative- 
ly, the remaining portion of the display can be a recon- 
figurable high-information content display area to selec- 
tively display various types of information. Such infor- 
mation may include incoming facsimile or pager infor- 

30 mation, phone numbers, and navigational aids including 
pull-up maps, route guidance information, global posi- 
tioning system (GPS) data, intelligent vehicle highway 
system (IVHS) information, as well as radio and envi- 
ronmental system control settings, and the like. Display 

35 20 is especially useful for displaying such alternative da- 
ta. Because display 20 has a very long focal length, the 
driver may consult the alternative data by switching the 
gaze of the driver between forward field of view 70 and 
to display 20 which does not require extensive refocus- 

40 ing of the driver's eyes. This allows the driver to consult 
the alternative data quickly with reduced fatigue and dis- 
traction. The content of the auxiliary information dis- 
played may be user-selectable by a keypad, trackball, 
or other input device on the dashboard, steering column, 

45 or other position readily accessible to the driver. 

[0034] Although various camera devices may be uti- 
lized for image capture devices 14, 16, an electro-optic, 
pixilated imaging array, located in the focal plane of an 
optical system, is preferred. Such imaging array allows 

50 the number of pixels to be selected to meet the require- 
ments of rearview vision system 12. The pixel require- 
ments are related to the imaging aspect ratio of the re- 
spective image capture devices, which, in turn, are a 
function of the ratio of the vertical-to-horizontal field of 

55 view of the devices, as is well known in the art. In the 
illustrated embodiment, the imaging aspect ratio of side 
image capture devices 14 is 2:1 and the image aspect 
ratio of central image capture device 1 6 is variable down 
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to 0.1:1. Such aspect ratio will produce images which 
will not typically match that of commercially available 
displays. A commercially available display may be used, 
however, by leaving a horizontal band of the display for 
displaying alpha-numeric data, such as portions of an 5 
instrument cluster, compass display, or the like, as illus- 
trated in Fig. 3. 

[0035] In the illustrated embodiment, image capture 
devices 14, 16 are CMOS imaging arrays of the type 
manufactured by VLSI Vision Ltd. of Edinburgh, Scot- 
land. 

[0036] However, other pixilated focal plane image-ar- 
ray devices, which are sensitive to visible or invisible 
electromagnetic radiation, could be used. The devices 
could be sensitive to either color or monochromatic vis- 
ible radiation or near or far infrared radiation of the type 
used in night-vision systems. Each image capture de- 
vice could be a combination of different types of devices, 
such as one sensitive to visible radiation combined with 
one sensitive to infrared radiation. Examples of other 
devices known in the art include charge couple devices 
and the like. 

[0037] Preferably, image capture devices 14 and 16 
are all mounted at the same vertical height on vehicle 
10, although compromise may be required in order to 
accommodate styling features of the vehicle. The hori- 
zontal aim of image capture devices 14 and 16 is pref- 
erably horizontal. However, the portion of the image dis- 
played is preferably biased toward the downward por- 
tion of the captured image because significantly less 
useful information is obtained above the horizontal po- 
sition of the image capture devices. 
[0038] Each image-capturing device 1 4, 1 6 is control- 
led by appropriate supporting electronics (not shown) 
located in the vicinity of the imaging array such that, 
when operating power is supplied, either an analog or 
a digital data stream is generated on an output signal 
line supplied to image processor 18. The support elec- 
tronics may be provided partially on the image chip and 
partially on associated electronic devices. For each ex- 
posure period, a value indicative of the quantity of light 
incident on each pixel of the imaging array during the 
exposure period is sequentially outputted in a predeter- 
mined sequence, typically row-by-row. The sequence 
may conform to video signal standards which support a 
direct view such that, when a scene is viewed by an im- 
age-capturing device, the image presented on a display 
represents directly the scene viewed by the image-cap- 
turing devices. However, when looking forward and ob- 
serving a displayed image of a rearward scene, the driv- 
er will interpret the image as if it were a reflection of the 
scene as viewed through a mirror. Objects to the left and 
rearward of the vehicle, as viewed by the rearward-look- 
ing camera, are presented on the left-hand side of the 
display and vice versa. If this reversal is effected in im- 
age processor 1 8, it may be by the use of a data storage 
device, or buffer, capable of storing all of the pixel values 
from one exposure period. The data is read out of the 



data storage device in a reversed row sequence. Alter- 
natively, the imaging array electronics could be con- 
structed to provide the above-described reversal at the 
image-capturing device or at the display. 
[0039] Data transmission between image capture de- 
vices 14, 16 and image processor 18 and/or between 
image processor 18 and display 20 may be by electri- 
cally conductive leads. The leads may comprise either 
a serial or parallel bus. Alternatively, the data transmis- 
sion may be via plastic or glass fiber-optic cable or an 
RF link. It is possible, for particular applications, to elim- 
inate image processor 18 and direct drive display 20 
from image capture devices 1 4, 1 6 at the pixel level. This 
may be accomplished by providing an interface between 
the output of image capture device 14, 16 and display 
20 which synchronously maps image pixels captured by 
the image capture device, or devices, to the display. This 
synchronous mapping may be accomplished by provid- 
ing a one-to-one mapping in which each pixel measure- 
ment is communicated to the display. Alternatively, the 
interface may only transmit pixel data which represents 
changes in the captured image. This allows for a reduc- 
tion in the communication bandwidth necessary to 
transmit data between the image capture device, or de- 
vices, and the display. This may be accomplished by en- 
coding the pixel data which represents changes in the 
captured image with additional data which designates 
the position of the pixel or other relevant information. 
Communication between the image capture device, or 
devices, may be multiplexed. 

[0040] The data streams from image-capturing devic- 
es 14, 16 are combined in image processor 18 and di- 
rectly mapped to the pixel array of display 20. This proc- 
ess is repeated preferably at a rate of at least 30 times 
per second in order to present an essentially real time 
video image. The image captured by side image capture 
device 14 on the right side of the vehicle is presented in 
right image portion 46 and the image from side image 
capture device 14 on the left side of the vehicle is dis- 
played on left image portion 44. The image from center 
image capture device 16 is displayed on central image 
portion 48. The three image portions 44-48 are present- 
ed in horizontal alignment and adjacent to each other. 
However, the composite image may be positioned at 
any desired vertical position in the display 20. It is also 
possible to display image portions 44-48 on separate 
image devices which are adjacent each other. 
[0041] In vision system 12, side image capture devic- 
es 14 are positioned preferably at a forward longitudinal 
position on vehicle 10 and center image capture device 
16 is positioned at a rearward longitudinal position on 
the vehicle. As best seen by reference to Fig. 7, this po- 
sitioning creates a difference in the vertical angle be- 
tween each side image capture device 14 and center 
image capture device 16 with respect to a fixed location 
P 1 that is a distance D-, behind the vehicle. This differ- 
ence in sensing angle will cause each side image cap- 
ture device 14 to image an object located at P 1 on a 
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horizontal row of pixels that is different from the horizon- 
tal row of pixels that center image capture device 1 6 will 
image the same object. If the image is below the hori- 
zontal centerline of the image capture device, it will be 
imaged on a lower row of pixels by center image capture 5 
device 16 than the row of pixels it will be imaged by the 
side image capture devices 14, as illustrated in Fig. 7. 
This mismatch between horizontal pixel rows of the cap- 
tured image is furthermore a function of the distance of 
the captured image from the rear of the vehicle. This can 
be understood by reference to Fig. 11 which presents a 
chart 90 having a first column 92 of pixel lines n1 , meas- 
ured from the array centerline, at which an object will be 
imaged by side image capture device 14 and a second 
column 94 of pixel lines n2, measured from the array 
vertical centerline, at which the same object will be im- 
aged by center image capture device 16. The result is 
that an object, which is captured by both side and center 
image capture devices 14, 16, will be vertically disjoint- 
ed at the boundary of the displayed image, if the object 
is captured by more than one image capture device. The 
amount of disjointment will be greater closer to the ve- 
hicle and less at further distances. If the object is elon- 
gated in the horizontal direction, such as earth's horizon, 
bridges, or cross-markings on highways, then the object 
will appear to be either broken or crooked. 
[0042] In order to provide uniform display of laterally 
elongated images, a rearview vision system 12' is pro- 
vided having a central image portion 48' which is proc- 
essed differently from the image display portions 44' and 
46' produced by the side image capture devices (Fig : 
8). Central image portion 48' is reduced vertically, or 
compressed, by removing specified scan lines, or pixel 
rows, from the image captured by center image capture 
device 16 in a graduated fashion. The difference in the 
pixel line at which an object will be imaged by each of 
the side and center image capture devices is a function 
of the distance D of the object from the rear of the vehi- 
cle, with a greater variation occurring at shorter distanc- 
es and the variation reducing to zero for infinite distanc- 
es. Therefore, the compression of central image portion 
48' is non-linear, with substantially no compression at 
the vertical center of the image and greater compression 
at greater distances above and below the vertical center 
point of the image. This is accomplished by removing 
specific lines from the center display in a graduated 
fashion with a greater number of lines removed further 
from the vertical center of the image. The removed lines 
may be merely discarded in order to vertically reduce 
the image. Alternatively, the data contained in the re- 
moved lines may be utilized to modify the value of ad- 
jacent pixels above and below the removed line in order 
to enhance the quality of the compressed image. Aver- 
aging, median filtering, or other such known techniques 
may also be used. 

[0043] Each of right image portion 46' and left image 
portion 44* includes an upper portion 64 which extends 
above the compressed upper portion of the central im- 



age portion 48'. In the illustrated embodiment, upper 
portions 64 are deleted in order to present a uniform up- 
per horizontal boundary for display 20*. In the illustrated 
embodiment, the mismatch between the lower horizon- 
tal boundary of central image portion 48' and each of 
the left and right image portions provides a dead space 
66 which provides a visual prompt to the user of the ap- 
proximate location of the rearward corners S of vehicle 
10. This dead space 66 in the image displayed on dis- 
play 20' approximates the footprint occupied by vehicle 
10 when viewed from point C. This is particularly useful 
because it provides a visual indication to the driver that 
a vehicle passing vehicle 10, as viewed in either left im- 
age portion 44' or right image portion 46', is at least par- 
tially adjacent vehicle 1 0 if the image of the approaching 
vehicle is partially adjacent to dead space 66. 
[0044] In an alternative embodiment, the vertical com- 
pression technique may be applied to only a lower ver- 
tical portion of central image portion 48'. In most driving 
situations, objects imaged by rearward -facing image 
capture devices above the horizon are at a long distance 
from the vehicle while those below the horizon get pro- 
gressively closer to the vehicle in relation to the distance 
below the horizon in the displayed image. Therefore, 
compression of the upper vertical portion of the central 
image portion may be eliminated without significant re- 
duction in performance. 

[0045] Compression of the central image portion may 
also advantageously be provided horizontally, as well 
as vertically. Spatial separation of center image capture 
device 16 from side image capture devices 14 causes 
similar distortion, as that described above, in the hori- 
zontal direction. This effect is spherical in nature and 
would require a more complex corrective action, such 
as compressing the image based upon the removal of 
pixels from an approximation to concentric circles cen- 
tered on the center of the imaging array, or other tech- 
niques which would be apparent to those skilled in the 
art. 

[0046] A rearview vision system 12" includes an im- 
age display 20" having a compressed central image por- 
tion 48" and left and right image portions 44" and 46", 
respectively (Fig. 1 0). A border 50' between left side im- 
age 44" and central image 48" includes a vertical central 
border portion 50a', an upper border portion 50b', and 
a lower border portion 50c'. Upper border portion 50b' 
and lower border portion 50c' diverge laterally outward- 
ly, vertically away from central portion 50a'. A border 52' 
between central image portion 48" and right image por- 
tion 46" includes a central boundary portion 52a', an up- 
per boundary portion 52b', and a lower boundary portion 
52c'. Upper boundary portion 52b' and lower boundary 
portion 52c* diverge laterally outwardly vertically away 
from central portion 52a'. This creates an upper portion 
of central image portion 48" and a lower portion of cen- 
tral image portion 48" which extend beyond the center 
portion thereof. This configuration is based upon the re- 
alization that the surface of the road immediately behind 
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the vehicle is captured by central image capture device 
16. Likewise, the horizontal plane above the vehicle, 
which is symmetrical with the road surface, is captured 
by the center image capture device. This may be seen 
by referring to point P in Fig. 10, which illustrate the 
points where the effective radius 68 of the virtual image 
capture device intersects dead zones 30 and by refer- 
ring to point S in Fig. 10 which illustrates the corners or 
the rear of the vehicle (S). 

[0047] The image displayed on display 20" includes a 
dead space 66' having diverging lateral sides 68a, 68b. 
Diverging sides 68a and 68b are configured in order to 
extend in the direction of travel of vehicle 10 which is 
parallel to lane markings of a highway on which vehicle 
1 0 is travelling. This further enhances the visual percep- 
tion of the driver by providing a visual clue of the location 
of images appearing on display 20" with respect to the 
vehicle 10. Side portions 68a, 68b, in the illustrated em- 
bodiment, are natural extensions of lower boundary por- 
tions 50c* and 52c' and extend from point S on each re- 
spective side of the vehicle to point R, which represents 
the intersection of the lower extent of the vertical field 
of view 40 of each side image capture device 14 with 
the pavement (Fig. 7). 

[0048] Rearview vision systems 12' and 12" utilize a 
displayed synthesized image which takes into account 
the use of perspective in enhancing the driver's under- 
standing of what is occurring in the area surrounding the 
vehicle. The images produced on displays 20' and 20" 
effectively remove the vehicle bodywork and replace the 
bodywork with a vehicle footprint as would be viewed by 
virtual camera C. The image displayed on display 20" 
further includes perspective lines which further enhance 
the roll of perspective in the driver's understanding of 
what is occurring. 

[0049] In order to further enhance the driver's under- 
standing of what is occurring in the area surrounding the 
vehicle, a rearview vision system 1 2'" includes a display 
20"' having image enhancements (Fig. 6). In the illus- 
trative embodiment, such image enhancements include 
graphic overlays 70a, 70b which are hash marks intend- 
ed to illustrate to the driver the anticipated path of move- 
ment of vehicle 10. In the illustrated embodiment, the 
anticipated vehicle motion is a function of the vehicle 
direction of travel as well as the rate of turn of the vehi- 
cle. The forward or rearward direction of vehicle travel 
is determined in response to the operator placing the 
gear selection device (not shown) in the reverse gear 
position. The degree of turn of the vehicle may be de- 
termined by monitoring the movement of the vehicle 
steering system, monitoring the output of an electronic 
compass, or monitoring the vehicle differential drive sys- 
tem. In the embodiment illustrated in Fig. 6, the config- 
uration of graphic overlays 70a, 70b indicates that the 
vehicle is in reverse gear and that the wheels are turned 
in a manner that will cause the vehicle to travel toward 
the driver's side of the vehicle. If the wheels were turned 
in the opposite direction, graphic overlays 70a, 70b 



would curve clockwise toward the right as viewed in Fig. 
6. If the vehicle's wheels were straight, graphic overlays 
70a, 70b would be substantially straight converging 
lines. If the vehicle is not in reverse gear position, graph- 
5 ic overlays 70a, 70b are not presented. Other types of 
graphic overlays of the displayed image are compre- 
hended by the invention. 

[0050] Horizontal grid markings on the display may be 
provided to indicate distances behind the vehicle at par- 

10 ticular markings. Such grid would allow the driver to 
judge the relative position of vehicles behind the 
equipped vehicle. In one embodiment, short horizontal 
lines are superimposed on the displayed image at reg- 
ular rearward intervals in horizontal positions which cor- 

15 respond to the boundaries of the lane in which the ve- 
hicle is travelling. In order to avoid confusion when the 
vehicle is travelling in a curved path, from a lack of cor- 
respondence between the graphic overlay and the road, 
a signal indicative of the vehicle's rate of turn may be 

20 taken into account when generating the graphic overlay. 
In this manner, the distance indications may be moved 
laterally, with reduced horizontal separation, to corre- 
spond to the positions of the curved lane boundaries and 
vertically on the image to compensate for the difference 

25 between distances along a straight and curved path. 
[0051] Another image enhancement is to alter the ap- 
pearance of an object in a particular zone surrounding 
the vehicle in order to provide an indication, such as a 
warning, to the driver. As an example, a vehicle that is 

30 too close to the equipped vehicle for safe-lane change, 
may be displayed in a particular color, such as red, may 
flash, or otherwise be distinguishable from other images 
on the display. Preferably, the speed of the equipped 
vehicle 10, which may be obtained from known speed 

35 transducers, may be provided as an input to the rear- 
view vision system in order to cause such warning to be 
a function of the vehicle speed which, in turn, affects the 
safe separation distance of vehicles. The operation of 
the turn signal may also be used to activate such high- 

40 lighting of other road users or to modify the scope of the 
image displayed. In order to determine the distance of 
objects behind vehicle 10, a separate distance-measur- 
ing system may be used. Such separate system may 
include radar, ultrasonic sensing, infrared detection, and 

45 other known distance-measuring systems. Alternative- 
ly, stereoscopic distance-sensing capabilities of side im- 
age capture devices 14 may be utilized to determine the 
separation distance from trailing objects utilizing known 
techniques. 

50 [0052] Thus, it is seen that the image displayed on dis- 
play 20-20'" may be different under different circum- 
stances. Such different circumstances may relate to the 
vehicle's direction of travel, speed, rate of turn, separa- 
tion from adjacent objects, and the like. 

55 [0053] Various other forms of image processing may 
be utilized with rearview vision system 12-12*". Lumi- 
nant and chrominant blending may be applied to the im- 
ages captured by image capture devices 14, 1 6 in order 
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to produce equality of the image data whereby the im- 
age portions appear as if they were produced by one 
image capture device. The dynamic range of the image 
capture devices may be extended in order to provide 
high quality images under all lighting conditions. Fur- 5 
thermore, individual pixel groups may be controlled in 
order to selectively compensate for bright or dark spots. 
For example, anti-blooming techniques may be applied 
for bright spots. Multiple exposure techniques may be 
applied to highlight dark areas. Image morphing and 
warping compensation techniques may additionally be 
applied. Resolution of the image capture devices and 
display may be selected in order to provide sufficient im- 
age quality for the particular application. 
[0054] A heater may be applied to each image capture 
device in order to remove dew and frost that may collect 
on the optics of the device. Although, in the illustrative 
embodiment, the optical centerline of the camera coin- 
cides with the field of view, particular applications may 
result in the centerline of the camera pointing in a direc- 
tion other than the centerline of the field of view. Al- 
though, in the illustrative embodiment, the image cap- 
ture devices are fixed, it may be desirable to provide se- 
lective adjustability to the image capture devices or op- 
tical paths in particular applications. This is particularly 
desirable when the system is used on articulated vehi- 
cles where automated and coordinated camera aim may 
be utilized to maintain completeness of the synthesized 
image. 

[0055] When operating the vehicle in the reverse di- 
rection, it may be desirable to provide additional data 
concerning the area surrounding the immediate rear of 
the vehicle. This may be accomplished by utilizing non- 
symmetrical optics for the center image capture device 
in order to provide a wide angle view at a lower portion 
of the field of view. Alternatively, a wide angle optical 
system could be utilized with the electronic system se- 
lectively correcting distortion of the captured image. 
Such system would provide a distortion-free image 
while obtaining more data, particularly in the area sur- 
rounding the back of the vehicle. 
[0056] The invention additionally comprehends the 
use of more than three image capture devices. In addi- 
tion to side image capture devices positioned at the front 
sides of the vehicle and a center image capture device 
positioned at the center rear of the vehicle, additional 
image capture devices may be useful at the rear corners 
of the vehicle in order to further eliminate blind spots. It 
may additionally be desirable to provide an additional 
center image capture device at a higher elevation in or- 
der to obtain data immediately behind the vehicle and 
thereby fill in the road surface detail immediately behind 
the vehicle. Such additional detail is particularly useful 
when operating the vehicle in the reverse direction. Of 
course, each of the image capture devices could be a 
combination of two or more image capture devices. 
[0057] Although the present invention is illustrated as 
used in a rearview vision system, it may find utility in 



other applications. For example, the invention may be 
useful for providing security surveillance in an area 
where a building or other object obstructs the view of 
the area under surveillance. Additionally, the invention 
may find application in night-vision systems and the like. 
For example, the invention may be applied to forward- 
facing night-vision systems, or other vision enhance- 
ment systems such as may be used in adverse weather 
or atmospheric conditions such as fog, applied to pro- 
vide an enhanced display of a synthesized image, which 
approximates a forward-facing view from a single virtual 
camera located rearwardly of the driver, taking advan- 
tage of the perspective features of the image. 
[0058] A rearview vision system 150 is provided 
which, in addition to displaying a rear image on display 
20 which is synthesized by image processor 1 8 from the 
output of image capture devices 14, 16, also supplies 
drive signals to an electrically operated optical device 
such as electro-optic mirror 152, an electro-optic win- 
dow 154, or both. Even though a panoramic view rear- 
ward of the vehicle is displayed on display 20, it may be 
desired to provide the driver with a rearview mirror of 
the type which has conventionally been provided on ve- 
hicles. One such mirror is an electro-optic mirror, such 
as an electrochromic mirror, a liquid crystal mirror, or a 
solenoid-operated prismatic mirror and the like. Addi- 
tionally, vehicles may be provided with electro-optic win- 
dows, such as sunroofs, rear windows, side windows, 
and the like, which change transmissivity in response to 
a drive signal to a partial light transmittance level. 
[0059] In US 5 550 677 A a technique is disclosed for 
producing a drive signal for an electrically operated op- 
tical device, such as an electro-optic mirror or window, 
from the image captured by a rearward-facing array. Uti- 
lizing the techniques disclosed therein, image processor 
1 8 produces a drive signal on line 1 56 in order to control 
the partial reflectance level of electro-optic mirror 152 
and a drive signal on line 158 in order to control the par- 
tial light transmittance level of electro-optic window 1 54. 
[0060] A rearview vision system 1 60 is provided which 
includes a near infrared illumination device 162 in order 
to enhance an image captured by image capture devic- 
es 14, 15 (Fig. 19). In the illustrated embodiment, infra- 
red illumination device 162 illuminates an area immedi- 
ately behind the vehicle. Preferably, the output of illumi- 
nation device 1 62 has a greater near infrared light output 
than visible light output. This allows an enhanced image 
to be captured by the image capture device without in- 
creasing the visible light perceived by drivers surround- 
ing the vehicle. Infrared illumination device 162 may be 
actuated in response to the vehicle being placed in re- 
verse gear. This provides backup illumination which is 
greatly enhanced without having an increased effect on 
other drivers, Alternatively, infrared illumination devices 
may be positioned, for example, at other locations on 
the side or even the front of a vehicle in order to enhance 
the image captured by the image capture device or de- 
vices. This is especially useful in order to utilize rearview 
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vision system 160 with a large truck, such as a trailer 
truck. This infrared illumination device may flood the ar- 
ea around the trailer with infrared light in order to en- 
hance the image captured by the image capture device, 
or devices, without distracting other drivers. 
[0061] Image capture device 14, 16 may include a 
housing 1 64 in which an antenna 1 66 is positioned. This 
provides a convenient and functional location for a re- 
ceiving antenna, such as the type used with a global po- 
sitioning system, cellular telephone, garage door open- 
er, radar distance sensing device, and the like. 
[0062] A heater 1 68 may be associated with the im- 
age capture device in order to stabilize the temperature 
of the device in low ambient temperature conditions. A 
similar heater may be supplied in display 20 in order to 
improve its performance in low ambient temperature 
conditions. A heater control 170 is provided in order to 
control the energization of heater 168 and, if utilized, the 
heater in the display. Heater control 170, preferably, en- 
ergizes heater 168 prior to the vehicle being started. 
This allows the temperature of the image capture device 
to be elevated to a more desirable temperature prior to 
the driver operating the vehicle. This may be accom- 
plished by heater control 170 being a proximity detector 
which detects a device carried by the driver as the driver 
approaches the vehicle. Alternatively, heater control 
1 70 may be responsive to a signal produced by a remote 
keyless entry device concurrently with the doors being 
activated. Alternatively, heater control 170 may be re- 
sponsive to the vehicle device being opened. 
[0063] A rearview vision system 1 72 is provided which 
provides an output, generally referred to at 174, from 
image processor 18 to display 20. Output 174 provides 
an indication when an object bears a predetermined re- 
lationship to the vehicle. Such object may be of interest 
because the object is in a blind spot of the vehicle, may 
be tailgating the vehicle, or may be an object in front of 
the vehicle which the vehicle is too close to. Display 20 
may respond to output 174 by highlighting the displayed 
vehicle, such as by displaying the vehicle in an artificial 
color, such as red, by flashing the image of the vehicle, 
or, otherwise, drawing the attention of the driver to the 
vehicle. Output 174 may be developed by image proc- 
essor 1 8 from the outputs of image capture devices 14, 
16. This may be accomplished by, for example, utilizing 
redundant image portions captured by the image cap- 
ture devices, even though not displayed by display 20, 
in order to calculate relative position of the object with 
respect to the vehicle. Alternatively, an object sensor 
176 may be provided in order to supply an output 178 
indicative of a predetermined positional relationship of 
an object sensed by the object sensor with respect to 
the vehicle. In the illustrated embodiment, object sensor 
176 may be a passive infrared sensor which senses the 
presence of an object in the vehicle's blind spot. Alter- 
natively, object sensor 176 may be a distance-measur- 
ing device, such as an active infrared sensor, an ultra- 
sonic sensor, a radar sensor, or the like. Such object 



sensor is especially useful in determining the separation 
distance between the vehicle and objects in front of the 
vehicle. Preferably, object sensor 176 has a sensing 
field of view that is substantially coincident with the field 
of view of one or more of the image capture devices 14, 
16. 

[0064] A rearview vision system 1 78 is provided which 
has the capability of displaying stereoscopic images 
rearward of the vehicle. Rearview vision system 178 in- 
cludes at least one pair of image capture devices 14a, 
which are closely positioned on the vehicle and have 
overlapping fields of view. Because the image capture 
device pairs are closely positioned, they capture sub- 
stantially the same image but from a slightly different 
angle. This allows image processor 1 8 to produce a vid- 
eo signal 1 00' with stereoscopic information. This signal 
is utilized by a stereoscopic display 320 in order to pro- 
duce a stereoscopic image rearward of the vehicle. 
Such stereoscopic displays are known in the art. Al- 
though one pair of image capture devices are illustrated 
in Fig. 22, rearview vision system 178 may include mul- 
tiple pairs of image capture devices. This allows a rear 
image to be synthesized from the multiple pairs of image 
capture devices in order produce a panoramic view rear- 
ward of the vehicle and stereoscopic image. Preferably, 
utilizing other aspects of the invention, the stereoscopic 
image is a rearward-facing view from a single location. 
[0065] A rearview vision system 1 80 is provided which 
produces an indication 182 of road line markings. Indi- 
cation 182 may also indicate road edges. Image proc- 
essor 18 detects the road line markings and the road 
edges from the images captured by image capture de- 
vices 14, 16. This feature may be further enhanced by 
combining it with an infrared illumination device 162 in 
order to further illuminate areas behind and around the 
vehicle in order to enhance the image of the road line 
markings and the road edges. Indication 182 may be 
utilized by display 20 in order to provide an indication of 
the vehicle with respect to the road line markings and 
road edges. The indication may further be utilized by an 
indicator which indicates the relative position of the ve- 
hicle in its lane. Additionally, the indication may be uti- 
lized to determine erotic vehicle operation, such as may 
occur when the driver begins to fall asleep, in order to 
provide a suitable alarm, or the like. 
[0066] A rearview vision system 184 is provided with 
capabilities for infrared communication with other vehi- 
cles and stationary beacons. Rearview vision system 
184 produces a communication data output 186 which 
includes communication data decoded from infrared 
signals detected by image capture device or devices 14, 
16. For example, suitable standards may be developed 
wherein vehicles are equipped with a pair of spaced 
apart infrared transmitters on a forward portion thereof. 
Image processor 18 may respond to the temporal and 
spatial patterns of infrared signals detected by image 
capture devices 14, 16 in order to determine the speed 
and distance and, thereby, the separation of the vehicles 
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as well as the rate of change of separation of the vehi- 
cles. Such information may be communicated to the 
trailing vehicle by an infrared transmitter (not shown) in 
order to control the speed of the trailing vehicle. This 
feature provides adaptive cruise control in which the 5 
speed of the trailing vehicle is controlled according to 
separation distance with leading vehicles. This allows 
high-speed convoying between vehicles. The commu- 
nication system may additionally provide for the identi- 
fication of emergency vehicles, and the like, which may 
transmit a unique temporal and/or spatial pattern of an 
infrared signal. The IR communication signal may addi- 
tionally be utilized to receive signals from stationary de- 
vices, such as location beacons and Intelligent Vehicle 
Highway System (IVHS) data. Because rearview vision 
system 1 84 has a field of view which extends generally 
rearwardly of the vehicle, the system provides the ca- 
pability for sensing information after the vehicle has 
passed the beacon. This provides an adjunct to infrared 
communication systems having a field of view generally 
forward of, or to the side of, the vehicle. 
[0067] A rearview vision system 188 is provided hav- 
ing extended dynamic range (Fig. 25). Rearview vision 
system 1 88 includes a pair of image capture devices 1 4 
and/or 16, each of which has an image-sensing array 
190. Each image capture device is capable of operating 
in either a color mode, in which a color image is dis- 
played on display 20, or a monochrome mode, in which 
a monochrome image is displayed on display 20. Sys- 
tem 1 88 includes an image luminance sensor 1 92 which 
senses the luminance level of images captured by im- 
age capture devices 14, 16. Image luminance sensor 
192 may switch the image capture devices between the 
color mode and the monochrome mode such that, when 
the image luminance is sufficiently high, the image cap- 
ture device, or devices, operate in a color mode. During 
low image luminance conditions, the image capture de- 
vice, or devices, are operated in a monochromatic mode 
which does not require as much image luminance. This 
extends the dynamic range of the system. Rearview vi- 
sion system 188 may additionally include an exposure 
control 194 which determines the exposure period for 
capturing each frame by arrays 190. In order to extend 
the dynamic range of system 188, exposure control 194 
may produce exposure intervals for arrays 190 which 
vary in length from interval-to-interval. Thus, a series of 
normal exposure intervals may be occasionally sup- 
planted by a longer exposure interval during which 
greater detail of the image may be captured. This en- 
hanced image may then be combined with the image 
captured during the shorter intervals into a merged im- 
age of enhanced detail. 

[0068] Rearview vision system 188 may additionally 
include a plurality of infrared shutters 196 which are in 
the optical paths 198 of arrays 190. Each infrared shut- 
ter 196 has at least one state in which infrared energy 
is generally not attenuated to array 1 90. In another state, 
the infrared shutter generally blocks infrared radiation 



from the array. The state of infrared shutters 196 is con- 
trolled by image luminance sensor 192. During periods 
of high image luminance, sensor 192 may switch the in- 
frared shutters 196 to a state blocking near infrared ra- 
diation from arrays 190. However, during low image lu- 
minance conditions, sensor 198 may switch the infrared 
shutters 1 96 to a state in which the near infrared energy 
is transmitted to arrays 190. The addition of the near 
infrared radiation at low luminance levels enhances the 
image luminance sensed by arrays 1 90. In the illustrated 
embodiment, infrared shutters 196 are either electro- 
chromic shutters or liquid crystal shutters, both of which 
are known in the art. Rearview vision system 188 addi- 
tionally includes means for coordinating the image in- 
tensity received from multiple image capture devices 
and displayed on display 20. This allows a balance com- 
posite image to be displayed on the display. This may 
be provided by a display intensity control 200 which reg- 
ulates the intensity of the output of both arrays 1 90 in 
order to produce color and luminance balancing be- 
tween the multiple image capture devices. Instead of a 
separate display intensity control, a direct communica- 
tion channel may be developed between the image cap- 
ture devices in order to provide color and luminance bal- 
ancing. 

[0069] Each image pixel captured by image capture 
devices 14, 16 and displayed on display 20 has a reso- 
lution which affects the amount of image detail dis- 
played. While it is desirable to have a high degree of 
detail of displayed image, the increase in image resolu- 
tion produces a commensurate increase in system cost. 
While it is desirable to reduce system cost, this should 
not be achieved by sacrificing necessary detail in the 
displayed image. According to the invention, it has been 
determined that sufficient image detail may be obtained 
at a suitable system cost by having a pixel resolution in 
the range of between approximately 2 arc minutes and 
approximately 8 arc minutes. Preferably, system reso- 
lution is approximately 6 arc minutes. 
[0070] It is known in the art to provide imaging array 
capture devices having mosaic filters which mask image 
radiation in order to produce pixels which respond re- 
spectively to red, green, and blue light. Because such 
known pixel filter masks do not adequately absorb near 
infrared radiation, it is known to supply infrared filters in 
order to block infrared radiation from the pixels so that 
the pixels respond to only the designed radiation band. 
However, such additional filters have undesirable char- 
acteristics including costs. It has been discovered that 
a pixel filter mask may be made responsive to red, 
green, or blue light while filtering out near infrared by 
adding appropriate dyes to the dyes making up the filter 
mask. 

[0071] The heater supplied with each image capture 
device may include a transparent conductive coating 
applied to a window covering the device lens. Alterna- 
tive heater constructions include ITO or a series of fine 
wire mesh. This provides protection of the lens of the 
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image capture device from physical harm while allowing 
moisture and frost to be removed from the window. 
[0072] Various manipulation techniques may be ap- 
plied to image capture devices 14, 16. For example, 
when the invention is applied to semi-tractor/trailer com- 
binations, the image capture devices may be motorized 
and responsive to signals representing the relative po- 
sition of the trailer and the cab in order to produce full 
panoramic view during various maneuvers of the vehi- 
cle. For example, as the vehicle turns, which may cause 
the trailer to otherwise block the image captured by a 
side image capture device, the image capture device 
may pivot to a different panoramic view which is not 
blocked by the trailer. Additionally, the panoramic view 
sensed by the image capture device may be different 
when the trailer is attached than when the trailer is not 
attached. In a similar fashion, rearward-mounted image 
capture device 16 may be motorized to move vertically 
upwardly and downwardly between a first position when 
the vehicle is moving in a forward direction and a second 
position when the vehicle is in reverse gear. In the sec- 
ond position, the motorized camera is directed more 
downwardly in order to capture images closer to the rear 
of the vehicle which may be contacted by the vehicle. 
Image capture devices 14, 16 may be supplied with 
electrical opto-mechanical zoom devices as well as vi- 
bration isolation and compensation stabilizing devices. 
[0073] Image processor 1 8 may provide an input to a 
control for the intensity of the brake lights, turn signals, 
and the like for the vehicle. In this manner, the image 
processor may control the intensity of such lights based 
upon ambient lighting conditions. This allows the inten- 
sity of the rearward directed lights to be less distracting 
for following vehicles. 

[0074] Additionally, the present invention may be uti- 
lized for providing guidance for a tractor/trailer or like 
vehicle backing to a loading dock. Additionally, the in- 
vention may provide guidance for proper alignment of 
the trailer and tractor which are being joined by backing 
of the tractor. The present invention may additionally 
provide accident monitoring by capturing a predeter- 
mined continuous stream of images, such as, for exam- 
ple, 15 seconds. This running store of image may be 
frozen upon impact of the vehicle, in order to record 
events leading up to the impact, or may be stopped by 
a manual input. Furthermore, the invention may be uti- 
lized to alert the driver to an impending rear-end colli- 
sion. The vehicle may respond to such indication by de- 
ploying an appropriate device, such as a smart headrest 
or the like. 

[0075] Thus, it is seen that the present invention en- 
hances the relationship between the driver's primary 
view and the image presented on the rearview vision 
system. This is accomplished in a manner which pro- 
vides ease of interpretation while avoiding confusion so 
that the driver does not have to concentrate or look 
closely at the image. In this manner, information pre- 
sented on the display is naturally assimilated. This is 



accomplished while reducing blind spots so that other 
vehicles or objects of interest to the driver will likely be 
displayed to the driver. Additionally, the use of perspec- 
tive allows distances to be more accurately determined. 
5 [0076] Changes and modifications in the specifically 
described embodiments can be carried out without de- 
parting from the principles of the invention, which is in- 
tended to be limited only by the scope of the appended 
claims, 

10 

Claims 

1. A rearview vision system for a vehicle, comprising 
15 at least two image capture devices (14, 16) posi- 
tioned on the vehicle (10) and directed generally 
rearwardly with respect to the direction of travel (T) 
of the vehicle, and a display system (20) which dis- 
plays an image (42) synthesized from the outputs 

20 of said image capture devices, characterised in 
that the synthesized image approximates a rear- 
ward-facing panoramic view from a single location 
substantially without duplicate redundant images of 
objects. 

25 

2. The rearview vision system in claim 1 wherein said 
single location is forward of the driver with respect 
to said direction of travel and said rearward-facing 
view is unobstructed by the vehicle. 

30 

3. The rearview vision system claimed in claim 1 or 2 
wherein the displayed image (42) includes a visual 
prompt of the location of said vehicle (10) in said 
view. 

35 

4. The rearview vision system claimed in claim 3 
wherein said visual prompt is an outline of an area 
(66') which would substantially be occupied by said 
vehicle in said view. 

40 

5. The rearview vision system claimed in claim 3 
wherein said visual prompt includes perspective 
lines which are aligned with said direction of travel. 

45 6. The rearview vision system claimed in any one of 
claims 1 to 5 wherein there are at least three image 
capture devices including at least two side image 
capture devices (14) positioned on opposite lateral 
sides of said vehicle (10) and at least one center 

50 image capture device (16) laterally between said 
side image capture devices, the displayed image in- 
cluding an image portion (44", 46", 48") from each 
of said image capture devices (14, 16). 

55 7. The rearview vision system in claim 6 wherein said 
at least three image capture devices are aimed 
along non-parallel axes. 
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8. The rearview vision system claimed in claim 6 or 7 
wherein said image portion (48") from said center 
image capture device (16) has a vertically central 
portion and vertically upper and lower portions, 
wherein said upper and lower portions are laterally 
wider than the said central portion. 

9. The rearview vision system claimed in claim 6, 7 or 
8 wherein said image portion (48") from said center 
image capture device (16) is compressed. 

10. The rearview vision system claimed in any one of 
claims 6 to 9 wherein said display system (20) in- 
cludes multiple contiguous display surfaces, one of 
said surfaces for each of said image portions. 

11. The rearview vision system claimed in any one of 
claims 6 to 9 wherein said display system includes 
a single display surface for displaying all of said im- 
age portions. 

12. The rearview vision system claimed in any one of 
claims 6 to 9 wherein the displayed image (42) in- 
cludes an image portion (48) from said center image 
capture device (16) which has a horizontal width 
that is narrower than the horizontal width of image 
portions (44, 46) from said side image capture de- 
vices (14). 

13. The rearview vision system claimed in claim 12 
wherein said horizontal width of said image portion 
(48) from said center image capture device is dy- 
namically adjustable. 

14. The rearview vision system in claim 1 3 wherein said 
horizontal width of said image portion (48) from said 
center image capture device is adjustable in re- 
sponse to vehicle speed. 

15. The rearview vision system claimed in any preced- 
ing claim, said display system (20) also producing 
a graphic overlay (70a, 70B) superimposed on said 
displayed image visible to the driver informing the 
driver of what is occurring in the area surrounding 
the vehicle. 

16. The rearview vision system claimed in claim 15 
wherein said graphic overlay is in the form of indicia 
(70a, 70b) of the anticipated path of travel of the 
vehicle. 

17. The rearview vision system claimed in claim 16 
wherein said graphic overlay (70a, 70b) is disabled 
when the vehicle is not in reverse gear. 

18. The rearview vision system claimed in claim 15 
wherein said graphic overlay (70a, 70b) has a form 
that is a function of at least one of the direction of 



travel and speed of the vehicle. 

19. The rearview vision system claimed in claim 15 
wherein said graphic overlay is indicating distances 

5 of objects behind the vehicle. 

20. The rearview vision system claimed in any preced- 
ing claim, wherein said display system (20) displays 
an image (42) at a focal length that is within the 

10 depth of field of a vehicle driver viewing a distant 
object. 

21. The rearview vision system claimed in claim 20 
wherein the displayed image (42) is substantially 

15 contiguous with the forward field of view of the ve- 
hicle driver at a focal length that is forward of the 
vehicle passenger compartment. 

22. The rearview vision system claimed in claim 20 or 
20 21 wherein said display system (20) includes an 

opaque viewing portion which blocks view of near 
field objects located between the forward field of 
view of the vehicle driver and the displayed image. 

25 23. The rearview vision system claimed in claim 20 
wherein said display system (20) defines an obser- 
vation cone (78) within which the image displayed 
by the display system can be observed and further 
including accommodating means (92) for accom- 
30 modating variation in relationship between a driv- 
er's head and said observation cone. 

24. The rearview vision system claimed in any preced- 
ing claim wherein said display system (20) has a 

35 variable luminance output which is varied as a func- 
tion of ambient light levels. 

25. The rearview vision system claimed in any preced- 
ing claim wherein said display system (20) includes 

40 an image generator (74) and an image magnifier 
(124) which magnifies an image generated by said 
image generator. 

26. The rearview vision system claimed in any preced- 
45 ing claim wherein said display device is an opaque 

display. 

27. The rearview vision system claimed in claim 26 
wherein said opaque display is at an angle with the 

50 generally forward field of view of the driver and di- 
rected toward the vehicle driver's generally forward 
field of view by a reflection device (140). 

28. The rearview vision system claimed in any one of 
55 claims 1 to 25 wherein said display device is a view- 
through heads-up display which projects an image 
on an image combiner (72) which combines the pro- 
jected image with an image forward of the vehicle. 
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ing claim, wherein said at least one image capture 
device includes an extended dynamic range to re- 
spond to variations in image illumination. 

5 40. The rearview vision system claimed in any preced- 
ing claim, further including a heater (1 68) in at least 
one of said image capture device and said display 
system, and a control (170) which energizes said 
heater during low temperature conditions prior to 

10 starting the vehicle. 



29. The rearview vision system claimed in claim 28 
wherein said image combiner (72) includes a sur- 
face of a vehicle windshield, 

30. The rearview vision system claimed in any preced- 
ing claim wherein said display system (20) also dis- 
plays at least one supplemental image. 

31. The rearview vision system claimed in any preced- 
ing claim, wherein said rear image displayed by said 
display system has an aspect ratio that is between 
approximately 4:1 and approximately 2:1. 

32. The rearview vision system claimed in any preced- 
ing claim, wherein the display system includes an 
electrically operated optical device (118) which is 
responsive to a drive signal in order to have a partial 
light transmission level, wherein said drive signal is 
produced from the output of at least one of said im- 
age capture devices. 

33. The rearview vision system claimed in any preced- 
ing claim, further including a near infrared illumina- 
tion device (162) positioned to illuminate an area 
outside of the vehicle in order to enhance an image 
captured by said image capture devices. 

34. The rearview vision system claimed in any preced- 
ing claim, further including a housing (164) for at 
least one said image capture device, and an anten- 
na (166) positioned in said housing in order to re- 
ceive electromagnetic radiation of a particular char- 
acteristic. 

35. The rearview vision system claimed in any preced- 
ing claim, further including designation means (1 74) 
for measuring the distance of objects from the ve- 
hicle and indicating objects which have a predeter- 
mined positional relationship to the vehicle. 

36. The rearview vision system claimed in any preced- 
ing claim, further including means (18, Fig. 23) re- 
sponsive to the output of at least one image capture 
device for detecting road lane markings rearward of 
the vehicle. 

37. The rearview vision system claimed in any preced- 
ing claim, further including an infrared communica- 
tion channel (186) which receives communications 
external of the vehicle. 

38. 



39. 



41. The rearview vision system claimed in any preced- 
ing claim, wherein said synthesized image has a 
pixel resolution in the range of between approxi- 

15 mately 2 arc-minutes and approximately 8 arc-min- 
utes. 

42. The rearview vision system claimed in claim 1, 
wherein said at least two image capture devices in- 

20 eludes multiple pairs of image capture devices 
(14A) with at least partially overlapping fields of 
view, and said synthesized image is a stereoscopic 
image (320). 

25 43. The rearview vision system claimed in any preced- 
ing claim, wherein said at least two image capture 
devices (14, 16) are CMOS imaging arrays. 



The rearview vision system claimed in any preced- 
ing claim, further including an interface (18) be- 
tween said outputs and said display device which 
synchronously maps image pixels from said outputs 55 
to said display system. 

The rearview vision system claimed in any preced- 



Patentanspriiche 

1 . Ruckblicksystem fur ein Fahrzeug, umfassend we- 
nigstens zwei Bilderfassungsvorrichtungen (14, 
16), die am Fahrzeug (10) positioniert und im Allge- 
meinen in Bezug auf die Fahrrichtung (T) des Fahr- 
zeugs ruckwarts gerichtet sind, und ein Anzeigesy- 
stem (20), das ein Bild (42) anzeigt, das von den 
Ausgaben der genannten Bilderfassungsvorrich- 
tungen synthetisiert wird, dadurch gekennzeich- 
net, dass das synthetisierte Bild in etwa einer hin- 
ten gelegenen Panoramaansicht von einem einzel- 
nen Ort aus entspricht, im Wesentlichen ohne uber- 
flussige Duplikatbilder von Objekten. 

2. Ruckblicksystem nach Anspruch 1 , wobei sich der 
genannte einzelne Ort in Bezug auf die genannte 
Fahrtrichtung vor dem Fahrer befindet und der ge- 
nannte Blick nach hinten durch das Fahrzeug nicht 
behindert wird. 

3. Ruckblicksystem nach Anspruch 1 Oder 2, wobei 
das angezeigte Bild (42) eine visuelle Ausgabe des 
Ortes des genannten Fahrzeugs (10) in der ge- 
nannten Ansicht beinhaltet. 

4. Ruckblicksystem nach Anspruch 3, wobei die ge- 
nannte visuelle Ausgabe ein Umriss eines Bereichs 
(66*) ist, der im Wesentlichen von dem genannten 
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Fahrzeug in der genannten Ansicht eingenommen 
wurde. 

5. Ruckblicksystem nach Anspruch 3, wobei die ge- 
nannte visuelle Ausgabe Fluchtlinien beinhaltet, die 
in der genannten Fahrtrichtung ausgerichtet sind. 

6. Ruckblicksystem nach einem der Anspruche 1 bis 
5, wobei wenigstens drei Bilderfassungsvorrichtun- 
gen vorhanden sind, die wenigstens zwei Seitenbil- 
derfassungsvorrichtungen (14), die auf gegenuber- 
liegenden lateralen Seiten des genannten Fahr- 
zeugs (10) positioniert sind, und wenigstens eine 
mittlere Bilderfassungsvorrichtung (1 6) lateral zwi- 
schen den genannten Seitenbilderfassungsvorrich- 
tungen einschlielien, wobei das angezeigte Bild ei- 
nen Bildabschnitt (44", 46", 48") von jedem der ge- 
nannten Bilderfassungsvorrichtungen (14, 16) be- 
inhaltet. 

7. Ruckblicksystem nach Anspruch 6, wobei die ge- 
nannten wenigstens drei Bilderfassungsvorrichtun- 
gen entlang nicht parallelen Achsen gerichtet sind. 

8. Ruckblicksystem nach Anspruch 6 Oder 7, wobei 
der genannte Bildabschnitt (48") von der genannten 
mittleren Bilderfassungsvorrichtung (16) einen ver- 
tikal mittleren Abschnitt und vertikal obere und un- 
tere Abschnitte aufweist, wobei die genannten obe- 
ren und unteren Abschnitte lateral breiter sind als 
der genannte mittlere Abschnitt. 

9. Ruckblicksystem nach Anspruch 6, 7 oder 8, wobei 
der genannte Bildabschnitt (48") von der genannten 
mittleren Bilderfassungsvorrichtung (16) kompri- 
miert ist. 

10. Ruckblicksystem nach einem der Anspruche 6 bis 
9, wobei das genannte Anzeigesystem (20) mehre- 
re aneinander grenzende Anzeigeflachen beinhal- 
tet, jeweils eine genannte Flache fur die jeweiligen 
genannten Bildabschnitte. 

11. Ruckblicksystem nach einem der Anspruche 6 bis 
9 t wobei das genannte Anzeigesystem eine einzige 
Anzeigeflache zur Anzeige aller genannten Bildab- 
schnitte umfasst. 

12. Ruckblicksystem nach einem der Anspruche 6 bis 
9, wobei das angezeigte Bild (42) einen Bildab- 
schnitt (48) von der genannten mittleren Bilderfas- 
sungsvorrichtung (16) umfasst, der eine horizontale 
Breite hat, die geringer ist als die horizontale Breite 
von Bildabschnitten (44, 46) von den genannten 
Seitenbilderfassungsvorrichtungen (14). 

13. Ruckblicksystem nach Anspruch 12, wobei die ge- 
nannte horizontale Breite des genannten Bildab- 



schnitts (48) von der genannten mittleren Bilderfas- 
sungsvorrichtung dynamisch verstellbar ist. 

14. Ruckblicksystem nach Anspruch 13, wobei die ge- 
5 nannte horizontale Breite des genannten Bildab- 
schnitts (48) von der genannten mittleren Bilderfas- 
sungsvorrichtung als Reaktion auf die Fahrzeugge- 
schwindigkeit verstellbar ist. 

10 15. Ruckblicksystem nach einem der vorherigen An- 
spruche, wobei das genannte Anzeigesystem (20) 
aufcerdem eine graphische Uberlagerung (70a, 
70b) uber dem fur den Fahrer sichtbaren genannten 
angezeigten Bild erzeugt, das den Fahrer uber die 

15 Geschehnisse in dem das Fahrzeug umgebenden 
Bereich informiert. 

16. Ruckblicksystem nach Anspruch 15, wobei die ge- 
nannte graphische Uberlagerung die Form von In- 

20 dikatoren (70a, 70b) des erwarteten Fahrwegs des 
Fahrzeugs hat. 

17. Ruckblicksystem nach Anspruch 16, wobei die ge- 
nannte graphische Uberlagerung (70a, 70b) deak- 

25 tiviert wird, wenn sich das Fahrzeug nicht im Ruck- 
wartsgang befindet. 

18. Ruckblicksystem nach Anspruch 15, wobei die ge- 
nannte graphische Uberlagerung (70a, 70b) eine 

30 Form hat, die wenigstens von der Fahrtrichtung und 
der Geschwindigkeit des Fahrzeugs abhangig ist. 

19. Ruckblicksystem nach Anspruch 15, wobei die ge- 
nannte graphische Uberlagerung Entfernungen von 

35 Objekten hinter dem Fahrzeug anzeigt. 

20. Ruckblicksystem nach einem der vorherigen An- 
spriiche, wobei das genannte Anzeigesystem (20) 
ein Bild (42) in einer Brennweite anzeigt, die sich 

40 innerhalb des Scharfentiefenbereichs eines Kraft- 
fa hrers befindet, der ein femes Objekt betrachtet. 

21 . Ruckblicksystem nach Anspruch 20, wobei das an- 
gezeigte Bild (42) im Wesentlichen an das vordere 

45 Blickfeld des Kraftfahrers angrenzt, mit einer 
Brennweite, die sich vor der Fahrgastzelle des 
Fahrzeugs befindet. 

22. Ruckblicksystem nach Anspruch 20 oder 21 , wobei 
50 das genannte Anzeigesystem (20) einen lichtun- 

durchlassigen Betrachtungsabschnitt umfasst, der 
die Ansicht von Nahfeldobjekten behindert, die sich 
zwischen dem vorderen Blickfeld des Kraftfahrers 
und dem angezeigten Bild befinden. 

55 

23. Ruckblicksystem nach Anspruch 20, wobei das ge- 
nannte Anzeigesystem (20) einen Beobachtungs- 
kegel (78) definiert, innerhalb dessen das von dem 
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Anzeigesystem angezeigte Bild beobachtetwerden 
kann, und ferner ein Anpassungsmittel (92) zum 
Anpassen von Abweichungen bei der Beziehung 
zwischen dem Kopf eines Fahrers und dem ge- 
nannten Beobachtungskegel umfasst. 

24. Ruckblicksystem nach einem der vorherigen An- 
spruche, wobei das genannte Anzeigesystem (20) 
eine variable Leuchtdichtenausgabe hat, die in Ab- 
hangigkeit vom Umgebungslichtniveau variiert. 

25. Riickblicksystem nach einem der vorherigen An- 
spruche, wobei das genannte Anzeigesystem (20) 
einen Bildgenerator (74) und einen Bildvergrbfcerer 
(124) umfasst, der ein von dem genannten Bildge- 
nerator erzeugtes Bild vergrofiert. 

26. Riickblicksystem nach einem der vorherigen An- 
spriiche, wobei die genannte Anzeigevorrichtung 
eine lichtundurchlassige Anzeige ist. 

27. Riickblicksystem nach Anspruch 26, wobei sich die 
genannte lichtundurchlassige Anzeige in einem 
Winkel zu dem allgemein vorderen Blickfeld des 
Fahrers befindet und in Richtung auf das allgemein 
vordere Blickfeld des Kraftfahrers durch eine Refle- 
xionsvorrichtung (140) gerichtet ist. 

28. Riickblicksystem nach einem der Anspruche 1 bis 
25, wobei die genannte Anzeigevorrichtung eine 
Durchsichtanzeige in Uberkopfhohe ist, die ein Bild 
auf einen Bildkombinierer (72) projiziert, der das 
projizierte Bild mit einem Bild vor dem Fahrzeug 
kombiniert. 

29. Riickblicksystem nach Anspruch 28, wobei der ge- 
nannte Bildkombinierer (72) eine Flache einer Fahr- 
zeugwindschutzscheibe beinhaltet. 

30. Ruckblicksystem nach einem der vorherigen An- 
spruche, wobei das genannte Anzeigesystem (20) 
auch wenigstens ein zusatzliches Bild anzeigt. 

31. Riickblicksystem nach einem der vorherigen An- 
spruche, wobei das von dem genannten Anzeige- 
system angezeigte Ruckseitenbild ein Formatver- 
haltnis hat, das zwischen etwa 4:1 und etwa 2:1 
liegt. 

32. Ruckblicksystem nach einem der vorherigen An- 
spruche, wobei das Anzeigesystem eine elektrisch 
betriebene optische Vorrichtung (118) umfasst, die 
auf ein Fahrsignal anspricht, urn ein partielles Licht- 
ubertragungsniveau zu haben, wobei das genannte 
Fahrsignal vom Ausgang von wenigstens einem der 
genannten Bilderfassungsvorrichtungen erzeugt 
wird. 



33. Ruckblicksystem nach einem der vorherigen An- 
spruche, ferner umfassend eine Beleuchtungsvor- 
richtung (162) im nahen Infrarot, die so positioniert 
ist, dass sie einen Bereich aufierhalb des Fahr- 

5 zeugs beleuchtet, urn ein von den genannten Bil- 
derfassungsvorrichtungen erfasstes Bild zu ver- 
bessern. 

34. Ruckblicksystem nach einem der vorherigen An- 
10 spruche, ferner umfassend ein Gehause (164) fur 

wenigstens eine der genannten Bilderfassungsvor- 
richtungen und eine Antenne (166), die in dem ge- 
nannten Gehause positioniert ist, urn elektroma- 
gnetische Strahlen einer bestimmten Charakteristik 
15 zu empfangen. 

35. Ruckblicksystem nach einem der vorherigen An- 
spruche, ferner umfassend ein Kennzeichnungs- 
mittel (174) zum Messen der Entfernung von Ob- 

20 jekten zu dem Fahrzeug und zum Angeben von Ob- 
jekten, die eine vorbestimmte Positionsbeziehung 
zu dem Fahrzeug haben. 

36. Ruckblicksystem nach einem der vorherigen An- 
25 spruche, ferner umfassend ein Mittel (18, Fig. 23), 

das auf die Ausgabe von wenigstens einer Bilder- 
fassungsvorrichtung anspricht, urn Fahrbahnmar- 
kierungen hinter dem Fahrzeug zu erfassen. 

30 37. Ruckblicksystem nach einem der vorherigen An- 
spruche, ferner umfassend einen Infrarot-Kommu- 
nikationskanal (186), der Kommunikationen aufter- 
halb des Fahrzeugs empfangt. 

35 38. Ruckblicksystem nach einem der vorherigen An- 
spruche, ferner umfassend eine Schnittstelle (18) 
zwischen den genannten Ausgangen und der ge- 
nannten Anzeigevorrichtung, die synchron Bildpixel 
von den genannten Ausgangen zu dem genannten 

40 Anzeigesystem ubertragt. 

39. Ruckblicksystem nach einem der vorherigen An- 
spruche, wobei die genannte wenigstens eine Bil- 
derfassungsvorrichtung einen erweiterten Dyna- 

45 mikbereich beinhaltet, um auf Bildbeleuchtungsva- 
riationen anzusprechen. 

40. Ruckblicksystem nach einem der vorherigen An- 
spruche, ferner umfassend eine Heizvorrichtung 

50 (168) in der genannten Bilderfassungsvorrichtung 
und/oderdem genannten Anzeigesystem, und eine 
Steuerung (170), die die genannte Heizvorrichtung 
bei Niedrigtemperaturbedingungen vor dem Star- 
ten des Fahrzeugs speist. 

55 

41. Ruckblicksystem nach einem der vorherigen An- 
spruche, wobei das genannte synthetisierte Bild ei- 
ne Pixelauflbsung im Bereich zwischen etwa 2 Bo- 
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genminuten und etwa 8 Bogenminuten hat. 

42. Ruckblicksystem nach Anspruch 1, wobei die ge- 
nannten wenigstens zwei Bilderfassungsvorrich- 
tungen mehrere Paare von Bilderfassungsvorrich- 
tungen (14A) mit wenigstens teilweise uberlappen- 
den Blickfeldern umfassen und das genannte syn- 
thetisierte Bild ein Stereobild (320) ist. 

43. Ruckblicksystem nach einem der vorherigen An- 
spruche, wobei die genannten wenigstens zwei Bil- 
derfassungsvorrichtungen (14, 16) CMOS-Abbil- 
dungsarrays sind. 



Revendications 

1 . Systeme de retrovision pour vehicule, comprenant 
au moins deux dispositifs de prise d'image (14, 16) 
positionnes surle vehicule (10) etdiriges de manie- 
re generate vers Parriere par rapport au sens de de- 
placement (T) du vehicule, et un systeme d'afficha- 
ge (20) qui affiche une image (42) synthetisee a par- 
tir des sorties desdits dispositifs de prise d'image, 
caracterise en ce que I'image synthetisee se rap- 
proche d'une vue panoramique faisant face a I'ar- 
riere depuis un emplacement unique sensiblement 
sans images redondantes dupliquees d'objets. 

2. Systeme de retrovision selon la revendication 1, 
dans lequel ledit emplacement unique se situe en 
avant du conducteur par rapport audit sens de de- 
placement et ladite vue faisant face a I'arriere n'est 
pas obstruee par le vehicule. 

3. Systeme de retrovision selon la revendication 1 ou 
2, dans lequel I'image affichee (42) comporte une 
indication visuelle de ^emplacement dudit vehicule 
(10) dans ladite vue. 

4. Systeme de retrovision selon la revendication 3, 
dans lequel ladite indication visuelle est un profil 
d'une zone (66*) qui serait sensiblement occupee 
par ledit vehicule dans ladite vue. 

5. Systeme de retrovision selon la revendication 3, 
dans lequel (adite indication visuelle comporte des 
lignes de perspective qui sont alignees par rapport 
audit sens de deplacement. 

6. Systeme de retrovision selon Tune quelconque des 
revendications 1 a 5, dans lequel existent au moins 
trois dispositifs de prise d'image comportant au 
moins deux dispositifs de prise d'image lateraux 
(14) positionnes sur des cotes lateraux opposes du- 
dit vehicule (10) et au moins un dispositif de prise 
d'image central (16) positionne lateralement entre 
lesdits dispositifs de prise d'image lateraux, I'image 



affichee comportant une partie d'image (44", 46", 
48") provenant de chacun desdits dispositifs de pri- 
se d'image (14, 16). 

5 7. Systeme de retrovision selon la revendication 6, 
dans lequel lesdits au moins trois dispositifs de pri- 
se d'image sont orientes selon des axes non paral- 
lels. 

10 8. Systeme de retrovision selon la revendication 6 ou 
7, dans lequel ladite partie d'image (48 n ) provenant 
dudit dispositif de prise d'image central (16) a une 
partie verticalement centrale et des parties vertica- 
lement superieure et inferieure, dans lequel lesdites 
15 parties superieure et inferieure sont lateralement 
plus larges que ladite partie centrale. 

9. Systeme de retrovision selon la revendication 6, 7 
ou 8, dans lequel ladite partie d'image (48") prove- 

20 nant dudit dispositif de prise d'image central (16) 
est comprimee. 

10. Systeme de retrovision selon I'une quelconque des 
revendications 6 a 9, dans lequel ledit systeme d'af- 

25 fichage (20) comporte de multiples surfaces d'affi- 
chage contigues, une desdites surfaces pour cha- 
cune desdites parties d'image. 

1 1 . Systeme de retrovision selon I'une quelconque des 
30 revendications 6 a 9, dans lequel ledit systeme d'af- 

fichage comporte une seule surface d'affichage 
pour afficher toutes lesdites parties d'image. 

12. Systeme de retrovision selon I'une quelconque des 
35 revendications 6 a 9, dans lequel ladite image affi- 
chee (42) comporte une partie d'image (48) prove- 
nant dudit dispositif de prise d'image central (16) 
qui a une largeur horizontale qui est plus etroite que 
la largeur horizontale des parties d'image (44, 46) 

40 provenant desdits dispositifs de prise d'image late- 
raux (14). 

13. Systeme de retrovision selon la revendication 12, 
dans lequel ladite largeur horizontale de ladite par- 

45 tie d'image (48) provenant dudit dispositif de prise 
d'image central est dynamiquement reglable. 

14. Systeme de retrovision selon la revendication 13, 
dans lequel ladite largeur horizontale de ladite par- 

50 tie d'image (48) provenant dudit dispositif de prise 
d'image central est reglable en reponse a la Vitesse 
du vehicule. 

15. Systeme de retrovision selon I'une quelconque des 
55 revendications precedentes, ledit systeme d'affi- 
chage (20) produisant aussi un recouvrement gra- 
phique (70a, 70B) superpose sur ladite image affi- 
chee visible par le conducteur informant le conduc- 
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teur de ce qui se passe dans la zone entourant le 
vehicule. 

16. Systeme de retrovision selon la revendication 15, 
dans lequel ledit recouvrement graphique a la for- 
me de references (70a, 70b) de la trajectoire anti- 
cipee de deplacement du vehicule. 

17. Systeme de retrovision selon la revendication 16, 
dans lequel ledit recouvrement graphique (70a, 
70b) est inhibe quand le vehicule n'est pas en mar- 
che arriere. 

18. Systeme de retrovision selon la revendication 15, 
dans lequel ledit recouvrement graphique (70a, 
70b) a une forme qui est fonction au moins d'un du 
sens de deplacement et de la vitesse du vehicule. 

19. Systeme de retrovision selon la revendication 15, 
dans lequel ledit recouvrement graphique indique 
des distances d'objets derriere le vehicule. 

20. Systeme de retrovision selon Tune quelconque des 
revendications precedentes, dans lequel ledit sys- 
teme d'affichage (20) affiche une image (42) a une 
longueur focale qui est comprise dans la profondeur 
de champ d'un conducteur de vehicule visualisant 
un objet distant. 

21. Systeme de retrovision selon la revendication 20, 
dans lequel Pimage affichee (42) est sensiblement 
contigue au champ avant de vision du conducteur 
de vehicule a une longueur focale qui est en avant 
du compartiment pour passagers du vehicule. 

22. Systeme de retrovision selon la revendication 20 ou 
21 , dans lequel ledit systeme d'affichage (20) com- 
porte une partie de visualisation opaque qui bloque 
ia vue des objets en champ proche situes entre le 
champ de vision avant du conducteur du vehicule 
et I'image affichee. 

23. Systeme de retrovision selon la revendication 20, 
dans lequel ledit systeme d'affichage (20) definit un 
cone d'observation (78) a I'interieur duquel I'image 
affichee par le systeme d'affichage peut etre obser- 
vee et incluant en outre un moyen d'adaptation (92) 
pour adapter le systeme a une variation de la rela- 
tion entre la tete du conducteur et ledit cone d'ob- 
servation. 

24. Systeme de retrovision selon Tune quelconque des 
revendications precedentes, dans lequel ledit sys- 
teme d'affichage (20) a une sortie de luminance va- 
riable qui varie en fonction des niveaux de lumiere 
ambiante. 

25. Systeme de retrovision selon Tune quelconque des 



revendications precedentes, dans lequel ledit sys- 
teme d'affichage (20) comporte un generateur 
d'images (74) et un grossisseur d'image (124) qui 
grossit une image generee par ledit generateur 
5 d'images. 

26. Systeme de retrovision selon Tune quelconque des 
revendications precedentes, dans lequel ledit dis- 
positif d'affichage est un affichage opaque. 

10 

27. Systeme de retrovision selon la revendication 26, 
dans lequel ledit affichage opaque est a un certain 
angle avec le champ de vision generalement avant 
du conducteur et dirige vers le champ de vision ge- 

15 neralement avant du conducteur du vehicule par un 
dispositif de reflexion (140). 

28. Systeme de retrovision selon I'une quelconque des 
revendications 1 a 25, dans lequel ledit dispositif 

20 d'affichage est un collimateur de pilotage transpa- 
rent qui projette une image sur un dispositif de com- 
binaison d'images (72) qui combine I'image proje- 
tee a une image en avant du vehicule. 

25 29. Systeme de retrovision selon la revendication 28, 
dans lequel ledit dispositif de combinaison d'images 
(72) inclut une surface d'un pare-brise de vehicule. 

30. Systeme de retrovision selon Tune quelconque des 
30 revendications precedentes, dans lequel ledit sys- 
teme d'affichage (20) affiche aussi au moins une 
image supplemental. 

31 . Systeme de retrovision selon I'une quelconque des 
35 revendications precedentes, dans lequel ladite ima- 
ge arriere affichee par ledit systeme d'affichage a 
un rapport hauteur/largeur qui se situe entre ap- 
proximativement 4:1 et approximativement 2:1. 

40 32. Systeme de retrovision selon I'une quelconque des 
revendications precedentes, dans lequel le syste- 
me d'affichage comporte un dispositif optique ac- 
tionne electriquement (118) qui est sensible a un 
signal de commande afin d'avoir un niveau de trans- 
45 mission de lumiere partielle, dans lequel ledit signal 
de commande est produit a partir de ia sortie d'au 
moins un desdits dispositifs de prise d'image. 

33. Systeme de retrovision selon I'une quelconque des 
50 revendications precedentes, comportant en outre 

un dispositif d'eclairage prochede I'infrarouge (162) 
positionne pour eclairer une zone en dehors du ve- 
hicule afin de rehausser une image prise par lesdits 
dispositifs de prise d'image. 

55 

34. Systeme de retrovision selon I'une quelconque des 
revendications precedentes, comportant en outre 
un boitier (164) pour au moins un dit dispositif de 
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prise d'image, et une antenne (166) positionnee 
dans ledit boTtier afin de recevoir un rayonnement 
electromagnetique d'une caracteristique particulie- 
re. 

35. Systeme de retrovision selon Tune quelconque des 
revendications precedentes, comportant en outre 
un moyen de designation (1 74) pour mesurer la dis- 
tance d'objets a partir du vehicule et indiquant des 
objets qui ont une relation de position predetermi- 
nee avec le vehicule. 

36. Systeme de retrovision selon Tune quelconque des 
revendications precedentes, comportant en outre 
un moyen (18, figure 23) sensible a la sortie d'au 
moins un dispositif de prise d'image pour detecter 
le marquage routier en arriere du vehicule. 

37. Systeme de retrovision selon Tune quelconque des 
revendications precedentes, comportant en outre 
une voie de communication infrarouge (186) qui re- 
coit des communications externes au vehicule. 

38. Systeme de retrovision selon Tune quelconque des 
revendications precedentes, comportant en outre 
une interface (18) entre lesdites sorties et ledit dis- 
positif d'affichage qui met en correspondence de 
maniere synchrone des pixels d'image provenant 
desdites sorties avec ledit systeme d'affichage. 

39. Systeme de retrovision selon Tune quelconque des 
revendications precedentes, dans lequel ledit au 
moins un dispositif de prise d'image comporte une 
gamme dynamique etendue pour repondre a des 
variations d'eclairage d'image. 

40. Systeme de retrovision selon I'une quelconque des 
revendications precedentes, comportant en outre 
un radiateur (168) dans au moins un des dit dispo- 
sitif de prise d'image et dit systeme d'affichage, et 
une commande (170) qui excite ledit radiateur du- 
rant des conditions de basse temperature avant de 
demarrer le vehicule. 

41. Systeme de retrovision selon I'une quelconque des 
revendications precedentes, dans lequel ladite ima- 
ge synthetisee a une resolution de pixels dans la 
plage d' entre approximativement 2 arc-minutes et 
approximativement 8 arc-minutes. 

42. Systeme de retrovision selon la revendication 1, 
dans lequel lesdits au moins deux dispositifs de pri- 
se d'image comportent des paires multiples de dis- 
positifs de prise d'image (14A) avec des champs de 
vision se chevauchant au moins partiellement, et la- 
dite image synthetisee est une image stereoscopi- 
que (320). 



43. Systeme de retrovision selon I'une quelconque des 
revendications precedentes, dans lequel lesdits au 
moins deux dispositifs de prise d'image (14, 16) 
sont des reseaux d'imagerie CMOS. 
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